A Detection Method of Environmental Changes Using Recurrence Plots for Reinforcement Learning
نویسندگان
چکیده
In this article, we propose a novel method for detecting environmental changes in the reinforcement learning. The proposed method utilizes recurrence plots of state transitions of the system, and quantifies changes of the recurrence plot by a texture analysis. It is shown that the proposed method is effective to detect environmental changes.
منابع مشابه
Multicast Routing in Wireless Sensor Networks: A Distributed Reinforcement Learning Approach
Wireless Sensor Networks (WSNs) are consist of independent distributed sensors with storing, processing, sensing and communication capabilities to monitor physical or environmental conditions. There are number of challenges in WSNs because of limitation of battery power, communications, computation and storage space. In the recent years, computational intelligence approaches such as evolutionar...
متن کاملMini/Micro-Grid Adaptive Voltage and Frequency Stability Enhancement Using Q-learning Mechanism
This paper develops an adaptive control method for controlling frequency and voltage of an islanded mini/micro grid (M/µG) using reinforcement learning method. Reinforcement learning (RL) is one of the branches of the machine learning, which is the main solution method of Markov decision process (MDPs). Among the several solution methods of RL, the Q-learning method is used for solving RL in th...
متن کاملOnline Detection of Hydrodynamic Changes in Fluidized Bed using Cross Average Diagonal Line
Online detection of hydrodynamics of gas-solid fluidized bed was characterized using pressure fluctuations by cross recurrence plot (CRP) and cross recurrence quantification analysis (CRQA). Experiments were conducted in a lab scale fluidized bed of various particle sizes 150 μm, 280 μm and 490 μm at different gas velocities. Firstly, pattern changes of cross recurrence plot were discussed and ...
متن کاملA parameter control method in reinforcement learning to rapidly follow unexpected environmental changes.
In order to rapidly follow unexpected environmental changes, we propose a parameter control method in reinforcement learning that changes each of learning parameters in appropriate directions. We determine each appropriate direction on the basis of relationships between behaviors and neuromodulators by considering an emergency as a key word. Computer experiments show that the agents using our p...
متن کاملبهکارگیری روش غیرخطی منحنی بازگشتی برای شناسایی مؤلّفههای حافظهای برمبنای تک ثبت
Abstract: The purpose of this study was to apply recurrence plots on event related potentials (ERPs) recorded during memory recognition tests. EEG signals recorded during memory retrieval in four scalp region were used. Two most important ERP’s components corresponding to memory retrieval, FN400 and LPC, were detected in recurrence plots computed for single-trial EEGs. In addition, the RQA was ...
متن کامل